Optimal Algorithms for Distributed Optimization
نویسندگان
چکیده
In this paper, we study the optimal convergence rate for distributed convex optimization problems in networks. We model the communication restrictions imposed by the network as a set of affine constraints and provide optimal complexity bounds for four different setups, namely: the function $F(\xb) \triangleq \sum_{i=1}^{m}f_i(\xb)$ is strongly convex and smooth, either strongly convex or smooth or just convex. Our results show that Nesterov's accelerated gradient descent on the dual problem can be executed in a distributed manner and obtains the same optimal rates as in the centralized version of the problem (up to constant or logarithmic factors) with an additional cost related to the spectral gap of the interaction matrix. Finally, we discuss some extensions to the proposed setup such as proximal friendly functions, time-varying graphs, improvement of the condition numbers.
منابع مشابه
OPTIMAL DESIGN OF TRUSS STRUCTURES BY IMPROVED MULTI-OBJECTIVE FIREFLY AND BAT ALGORITHMS
The main aim of the present paper is to propose efficient multi-objective optimization algorithms (MOOAs) to tackle truss structure optimization problems. The proposed meta-heuristic algorithms are based on the firefly algorithm (FA) and bat algorithm (BA), which have been recently developed for single-objective optimization. In order to produce a well distributed Pareto front, some improvement...
متن کاملPareto-optimal Solutions for Multi-objective Optimal Control Problems using Hybrid IWO/PSO Algorithm
Heuristic optimization provides a robust and efficient approach for extracting approximate solutions of multi-objective problems because of their capability to evolve a set of non-dominated solutions distributed along the Pareto frontier. The convergence rate and suitable diversity of solutions are of great importance for multi-objective evolutionary algorithms. The focu...
متن کاملFOA: ‘Following’ Optimization Algorithm for solving Power engineering optimization problems
These days randomized-based population optimization algorithms are in wide use in different branches of science such as bioinformatics, chemical physics andpower engineering. An important group of these algorithms is inspired by physical processes or entities’ behavior. A new approach of applying optimization-based social relationships among the members of a community is investigated in this pa...
متن کاملA New Optimization Algorithm for Optimal Wind Turbine Location Problem in Constantine City Electric Distribution Network Based Active Power Loss Reduction
The wind turbine has grown out to be one of the most common Renewable Energy Sources (RES) around the world in recent years. This study was intended to position the Wind Turbine (WT) on a wind farm to achieve the highest performance possible in Electric Distribution Network (EDN). In this paper a new optimization algorithm namely Salp Swarm Algorithm (SSA) is applied to solve the problem of opt...
متن کاملPresenting an evolutionary improved algorithm for the multi-objective problem of distribution network reconfiguration in the presence of distributed generation sources and capacitor units with regard to load uncertainty.
Reconfiguration of distribution network feeders is one of the well-known and effective strategies in the distribution network to obtain a new optimal configuration for the distribution feeders by managing the status of switches in the distribution network. This study formulates the multi-objective problem of reconfiguration of a distribution network in the optimal presence of distributed genera...
متن کاملA SAIWD-Based Approach for Simultaneous Reconfiguration and Optimal Siting and Sizing of Wind Turbines and DVR units in Distribution Systems
In this paper, a combination of simulated annealing (SA) and intelligent water drops (IWD) algorithm is used to solve the nonlinear/complex problem of simultaneous reconfiguration with optimal allocation (size and location) of wind turbine (WT) as a distributed generation (DG) and dynamic voltage restorer (DVR) as a distributed flexible AC transmission systems (DFACT) unit in a distribution sys...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1712.00232 شماره
صفحات -
تاریخ انتشار 2017